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Our  primary  objective  is  to  carry  out  a  cellular  and  computational  analysis  of 
operant  conditioning  of  the  head  waving  response  in  Aplysia.  During  the  last 
twelve  month  period,  progress  has  been  made  in  five  areas:  We  ^ve  carried  out  a 
detailed  Iri nematic  analysis  of  the  operant  response;  (2)  We  have  identifi^  the 
biomechanical  principles  imderlying  the  operant  response;  (3)  We  have  identified 
the  precise  pattern  smd  timing  of  muscles  and  motor  neurons  during  head 
waving.  Advances  in  areas  1-3  above  have  allowed  us  (4)  to  construct  a 
quantitative  computational  model  of  head  waving  using  biological  pajrimeters.  In 
addition  (5)  We  have  identified  a  novel  form  of  reinforcement  for  conditioning  of 
head  waving  that  significantly  advances  the  cellular  and  computational  anal3rsis. 
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AMMUAL  TECHNICAL  REPORT 

Thomas  J.  Carew 
AFOSR-89-0362 


A.  OBJECTIVES 

The  overall  research  project  has  three  primary  objectives: 

1.  The  first  objective  is  to  carry  out  a  detailed  circuit 
analysis  of  the  neural  networks  underlying  operant 
conditioning  in  Aplysia. 

To  perform  a  complete  circuit  analysis  of  operant  conditioning 
we  are  specifying:  a)  the  operant  response  circuitry?  b)  feedback 
circuitry;  and  c)  reinforcement  circuitry  involved  in  the  learning. 


2.  The  second  objective  is  to  analyse  the  expression  of 
operant  conditioning  in  identified  neural  circuits. 

Three  experimental  strategies  are  being  used:  a)  We  are 
examining  neural  correlates  of  the  conditioning  in  previously 
trained  animals;  b)  we  are  producing  the  operant  conditioning  in 
vitro  while  recording  from  relevant  circuit  elements;  and  c)  we  are 
examining  neural  analogues  of  the  conditioning  by  direct  activation 
of  relevant  circuitry. 


3.  The  third  objective  is  to  generate  a  quantitative 
computational  model  of  operant  conditioning. 

An  essential  feature  of  the  computational  model  we  plan  to 
generate  is  that  it  will  use  empirically  derived  biophysical 
parameters,  synaptic  weights  and  circuit  properties  in  its 
construction.  The  modelling  analysis  will  be  carried  out  at  three 
levels:  a)  individual  circuit  elements;  b)  restricted  neural 
networks;  and  c)  simulations  of  adaptive  changes  within  elements 
and  networks. 


B.  STATUS  OF  THE  RESEARCH  EFFORT 


In  the  third  year  of  this  award  we  have  made  significant 
progress  towards  achieving  all  of  the  research  objectives  described 
above.  During  this  year,  important  progress  has  been  made  in  a 
quantitative  understanding  of  the  operant  response  on  kinematic, 
biomechanical,  muscular  and  cellular  levels,  which  in  turn  has 
premitted  formulation  of  a  computational  model  of  the  head  waving 
response  and  its  modification  through  learning.  I  will  discuss 
these  advances  in  the  paragraphs  that  follow. 


1 


w  7  ;iio  aee 


92-19164 

MIHIIIII 


1.  We  have  carried  out  a  detailed  kinewatic  analysis  of  the 
operant  response  (head  waving) . 

These  studies  allowed  us  to  specify  the  major  components  of 
the  headwaving  response  in  quantitative  terms.  These  data  were 
essential  for  building  the  computational  model  of  the  head  waving 
response  (see  #4  below) . 

2.  We  have  identified  the  biomechanical  principles  underlying 
the  head  waving  response. 

We  have  described,  for  the  first  time,  that  head  waving  in 
Aplysia  cannot  be  explained  in  terms  of  a  ’’muscular  hydrostat”  (a 
prevailing  model  in  the  field) .  Rather,  head  waving  requires 
coordinated  antagonism  between  identified  longitudinal  muscle 
groups . 

3.  We  have  identified  the  timing  and  pattern  of  muscle  and 
motor  neuron  activity  underlying  head  waving. 

These  studies  used  chronic  EMG  recording  in  intact  animals  to 
determine  the  precise  pattern  and  timing  of  muscular  and  neural 
activity  during  head  waving.  These  studie'^  also  provided  critical 
data  for  the  computational  model  (See  #4  below) . 

4.  We  have  developed  a  quantitative  computational  model  of 
head  waving  using  empirically  identified  biological 
parameters . 

These  studies  now  allow  us  to  examine  operant  conditioning  of 
head  waving  in  quantitative  terms,  combining  both  neurocomp- 
utational  and  theoretical  levels  of  analysis. 

5.  We  have  identified  a  new  fora  of  reinforcement  in 
conditioning  of  head  waving  that  allows  a  simultaneous 
cellular  analysis. 

We  have  found  that,  in  addition  to  light  as  an  aversive 
reinforcer  (Cook  and  Carew  1986,  1989a, b;  1991)  mild  electric  shock 
to  the  anterior  tentacle  produces  also  rapid  conditioning.  In 
addition  we  have  identified  the  sensory  neurons  carrying  this 
reinforcing  input  and  shown  that,  even  at  this  very  early  neural 
stage  in  information  processing,  learning-specific  changes  can  be 
identified  in  the  sensory  neurons.  These  studies  now  permit  a 
detailed  cellular  (and  ultimately  computational)  analysis  of  the 
reinforcement  pathway  for  operant  conditioning. 
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